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Abstract 

In this paper we obtain new effective results on the Halpern itera- 
tions of nonexpansive mappings using methods from mathematical logic 
or, more specifically, proof-theoretic techniques. We give effective rates 
of asymptotic regularity for the Halpern iterations of nonexpansive self- 
mappings of nonempty convex sets in normed spaces. The paper presents 
another case study in the project of proof mining, which is concerned with 
the extraction of effective uniform bounds from (prima-facie) ineffective 
proofs. 



1 Introduction 

This paper presents another case study in the project of proof mining, by which 
we mean the logical analysis of mathematical proofs with the aim of extracting 
new numerically relevant information hidden in the proofs. 

General logical metatheorems were obtained (using proof-theoretic methods) 
in [TU] and [3] for various classes of spaces in functional analysis and metric ge- 
ometry, such as metric, hyperbolic spaces in the sense of Reich/Kirk/ Kohlen- 
bach, CAT(O), (uniformly convex) normed and inner product spaces. Further 
examples (K-trees, hyperbolic spaces in the sense of Gromov and uniformly 
convex hyperbolic spaces) are discussed in [14| . These metatheorems guarantee 
a priorly, under very general logical conditions, the extractability of effective 
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bounds from large classes of proofs in functional analysis, and moreover they 
provide algorithms for actually extracting the bounds. The bounds are uniform 
for all parameters meeting very weak local boundedness conditions. We refer to 
Kohlenbach's forthcoming book for details [TTj . 

In this paper we apply proof mining to metric fixed point theory, more 
specifically to the (approximate) fixed point theory of nonexpansive mappings, 
one of the most active branches of nonlinear functional analysis. We refer to [7] 
for an extensive account of metric fixed point theory. 

In the following, {X, \\ ■ ||) is a normed space and C is a nonempty convex 
subset of X. A mapping T : C ^ C is called nonexpansive if for all x,y £ C, 

\\Tx-Ty\\ < \\x-y\\. 

The usual Picard iterations are not the proper iterations for nonexpansive 
mappings and that's why other iterations were considered in this case. The 
Krasnoselski-Mann iteration | 18i |13i [S] star-ting with x & C is defined by: 

xo := X, Xn+i ■= (1 - K)xn + XnTxn for n > 0, (1) 

where (A„)„>o is a sequence in [0, 1]. 

One of the most important notions in fixed point theory is the asymptotic 
regularity, defined in 2 , but already implicit in [131 1191 [3] . A mapping T : C ^ 
C is called asymptotically regular if for all x £ C , 

lim ||T"(a;) -r"+i(a;)|| = 0. 

n — *oo 

For constant A„ = A G [0, 1], the asymptotic regularity of the averaged mapping 
T\ := (1 — A)/ + XT is equivalent to the fact that lim \\xn — Txn\\ — for 

n — >oo 

all X E C. Therefore, for general (A„) in [0,1], a nonexpansive mapping T is 
Xn- asymptotically regular [T] if for all a; G C, 

lim ||a;„-Ta;„|| =0. (2) 

n — >oo 

Methods of proof mining were applied in [SKSlIIlllin] to obtain effective rates 
of as-ymptotic regularity for the Krasnoselski-Mann iterations of nonexpansive 
mappings in normed and CAT(0)-spaces or even in the more general class of 
(uniformly convex) hyperbolic spaces. 

In this paper, we consider other iterations, introduced in For x £ C and 
(An)n>i in [0, 1], the Halpern iteration starting with x is defined as: 

xo ■■= X, Xn+i ■■= Xn+ix + (l ~ Xn+i)Txn for n > 0. (3) 

As Wittmann remarked [23 121], if T is linear and A„ := , then a;„ = 

n + l' 

1 " 

y T^x, so the Halpern iterations could be regarded as nonlinear gener- 

1=0 

alizations of the usual Cesaro averages. 

One of the earliest and most important results on the convergence of Halpern 
iterations is the following one. 
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Theorem 1.1. JM Theorem 2] 

Let X be a Hilbert space, C Q X a nonempty closed convex subset, T : C ^ 
C nonexpansive and {^\n)n>i be a sequence in S [0, 1] satisfying the following 

oo oo 

conditions: lira A„ = 0, 7 A„ is divergent and y |A„+i — A„| is convergent. 

n—1 n—1 

Assume moreover that the set Fix{T) of fixed points of T is nonempty . 

Then for any x d C, the Halpern iteration (a;„)„>i is norm convergent to 
the unique fixed point Px of T with \\x — Px\\ < \\x — y\\ for any y £ Fix{T) . 

Generalizations of this theorem to the Banach space case and different con- 
ditions on (A„) were considered in numerous papers. We refer to [24j for a nice 
exposition. 

In the following, we consider the important problem of asymptotic regularity, 
this time associated to the Halpern iterations: lim \\xn ~ Txn\\ — 0, where 

n — >oo 

{xn)n>i is defined by ([3]). By inspecting the proof of Theorem 11.11 (and its 
generalizations), it is easy to see that the first step is to obtain asymptotic 
regularity, and that this can be done in a much more general setting. 

Thus, the following theorem, essentially contained in [211 [23], can be 
proved. 

Theorem 1.2. Let {X, \\ ■ ||) be a normed space, C X a nonempty convex 
subset and T : C C be nonexpansive. 

00 

Assume that (A„)„>i is a sequence in [0, 1] such that lim A„ — 0, / A„ is 

n=l 

00 

divergent and |A„+i — A„| is convergent. 

Let X £ C be such that (xn) is bounded. 
Then 

lim \\Xn - TXn\ = 0. 
n — >oc 

This theorem is our point of departure. By a logical analysis of its proof, we 
shall obtain a quantitative version (Theorem 12. 1[) , providing for the first time 
effective rates of asymptotic regularity for the Halpern iterates, that is rates of 
convergence of (||a;„ — Txn\\) towards 0. 

2 Main results 

Before stating our main theorem, let us recall some terminology. 

oc 

Let (a„)„>i be a sequence of real numbers. If the series a„ is divergent. 
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then a function 7 : N* ^ N* is called a rate of divergence of a„ if 

/7(") \ 

V?i e N* ^ a, > 71 . (4) 

If (a„)„>i is convergent, then a function 7 : (0, 00) — > N* is called a Cauchy 
modulus of (a„) if 

Ve > OVn e N* (a^(e)+„ - a^(e) < e) • (5) 
If lim a„ = a, then a function 7 : (0, cxo) — > N* is called a rate of convergence 

n — *oo 

of (a„) if 

V£>0Vn>7(£)(|a„-a| <e). (6) 
The following quantitative version of Theorem 11.21 is the main result of our 



paper. 

Theorem 2.1. Let {X, \\ ■ ||) be a normed space, C ^ X a nonempty convex 
subset and T : C ^ C be nonexpansive. 

oc 

Assume that {\n)n>i is a sequence in [0,1] such that lim A„ = 0, ^ A„ is 

~ n — >C30 — ^ 

n=l 

00 

divergent and |A„+i — A„| is convergent. Moreover, let a : (0, cxd) —i- N* 

Tl=l 

be a rate of convergence of (A„), /3 : (0, cxd) ^ N* be a Cauchy modulus of 

n 00 

Sn '■— l-^i+i ^ K \ 0-nd : N* — » N* be a rate of divergence of A,i. 

i—l n—1 

Let X G C be such that (x„) is bounded. 

Then lim — T'a;„|| = and moreover 

n — >oc 

Vee (O,2)Vn>$(a,/3,0,M,e) {\\xn-Tx4 <e), 

where 

A 9, M, e) = max [p (^) + 1 + [in (^)l ) > « } > 

M e N* is sttc/i that M > \\xn\\ + \\x\\ + \\Tx\\ for all n > 1. 

We shall give the proof of the above theorem in the last section of our paper. 
We derive now some further consequences. 

Corollary 2.2. Let {X, \\ ■ ||) be a normed space, C Q X a nonempty convex 
bounded subset with finite diameter dc and T : C C be nonexpansive. 
Assume that (A„)„>i satisfies the hypotheses of Theorem \2.1\ 
Then lim ||a;„ — — for all x € C and moreover 

n — >oo 

Ve e (0,2)Vn > /?, dc, e) (|lx„ -Ta;„|| < e), 
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wher 



$(a,/?,0,dc,e)=max|(?(^/3(^) +1 
M e N* is such that M > Mc- 



In 



(^) 



(4m) 



Proof. Since C is bounded, it has a finite diameter dc sup{||a;|| | x G C}. 
Moreover, for all a; G C, (a;„) is bounded and ||x„|| + ||a;|| + ||T.t|| < ?>dc- Apply 
now Theorem [O □ □ 



Thus, for bounded C, we get asymptotic regularity for general (A„) and an 
explicit rate of asymptotic regularity <i>(a, /3, 0, s) which depends only on 
the error e, on the diameter dc of C, and on (A„) via a, (3, 9, but not on the 
nonexpansive mapping T, the starting point a; G C of the Halpcrn iteration or 
other data related with C and X. 

Corollary 2.3. Let (X, \\ ■ ||) be a normed space, C C X he a nonempty convex 
subset and T : C C nonexpansive. 

Assume that (A„)„>i is a decreasing sequence in [0,1] such that lim A„ = 0, 

^ n — *cxj 

oo 

A„ is divergent and let a : (0, oo) N* be a rate of convergence of (A„) and 



N* be a rate of divergence of A„ . 



n=l 



Let X £ C be such that is bounded. 
Then lim ||x„ — TxnW — and moreover 



Ve G (0,2)Vn > *(a,6',M,e) (||a;„ -Tx„|| < e). 



wher 



^'(a,0,M,e)=max<j^(a(^) 



In 



/8M 



\AMJ 
Tx\\ for all n > 1. 



M G N* is such that M > \\xn\\ + \\x\\ + \ 
Proof. Remark that (A„) decreasing implies that 

n n 

Sn '■= ~ = ^^(-^i ~ ^i+l) = Ai — A„+i. 

i=l 1=1 

CXD 

Since lim A„ = 0, it follows that ^ |A„+i — A„| = Ai, that is it is convergent. 

n=l 

Moreover, for aU e > 0, n G N*, 



Sa(£)+r 



(Ai — ^a(e)+n+l) ~ (^1 — Xa{e) + l) — '^a(e) + l " Xa{s)+n+l 



< A 



a{e) + 



1 < ^Q(e) < £, 



since a is a rate of convergence of (A„). Thus, a is a Cauchy modulus of (s„), 
so we can apply now Theorem 12.11 with (3 :— a. □ □ 
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The rate of asymptotic regularity can be further simpHfied for A„ = 1/n. 

Corollary 2.4. Let {X, || • ||) be a normed space, C Q X a nonempty convex 
hounded subset with finite diameter dc and T : C —>^ C be nonexpansive. 

Assume that A„ ~ — for all n > 1. 

n 

Then lim ||a;„ — T'a;„|| = for all x G C and moreover 

n — >oo 

Vee (0,2)Vn> $(dc,£) (||x„-rx„|| <e), 



where 



^{dc,s) = exp In 4 



fWM 



\ e 

M eW is such that M > 3dc- 
Proof. Obviously, lim — = with a rate of convergence 

n — >oo 77, 



1. 



a : (0,cx)) ^ N*, a(e) = 

oo ^ 

Moreover, > — is divergent with a rate of divergence given by 
^-^ n 

n=l 

e-.N* -> N*, 61(77) = 4". 

Since, furthermore, ( — ) is decreasing, we can apply Corollaries 12.31 and 12.21 to 
get that lim \\xn — Txn\\ = for all a; G C and moreover 

Vee (O,2)Vn>*(a,0,M,e) {\\xn-TxJ <e), 

where 



'9{a,9,M,e) = max 6* a 



f— ) 

\8MJ 



1 + 



In 



, a 



and M e N* is such that M > 3c?c- Using that [a] < a + 1 and 1 + Ina < a for 
all a > 0, we get that 



< a 



/ £ \ „ 1 /8M\ / £ \ 8M 
hrTT +2 + ln <a{ — )+l + 



\8MJ 
8M 



\ £ / 

MI 16M 
2+ < + 3, 

£ £ 



\8MJ 



we get that 

*(a,6',A/,£) < 4^+3 = exp ( In 4. 
The conclusion follows now immediately. 



16 A/ 
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□ 



□ 
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Hence, we get an exponential (in 1/e) rate of asymptotic regularity in the case 

3 Some technical lemmas 

The following lemma collects some useful properties of Halpern iterations and 
it is essentially contained in [22l |23] . In order to make the paper self-contained, 
we still give the proof. 

Lemma 3.1. Let {X, \\ ■ ||) be a normed space, C C X be a nonempty convex 
subset, T : C C nonexpansive and (A„)„>i be a sequence in [0,1]. Assume 
that (Xn)n>i is the Halpern iteration starting with x G C. Then 

1. For all n > 1, 

\\Txn\\ < ||x„|| + ||.T|| + ||Ta:||, 
||ra;„-x„|| < ||x„+i - x„|| + A„+i||a; - ra;„||, 

||a;„+i - a;„|| < (1 - A„+i)||a;„ - a;„_il| + |A„+i - A„| ■ ||x - Ta;„_i||. 

2. If{Xn) is bounded, then (Tx„) is also bounded. Moreover, if M > ||a;n||, ||ra;„|| 
for all n > 1, then 

\\TXn - Xn\\ < \\Xn+l - Xn\\ + 2AfA„+i, 

||2:„+i-x„|| < (1 - A„+i)||x„ - a;„_i|| + 2M|A„+i - A„ 
for all n > 1. 
Proof. 1 . 

\\TXn\\ < \\TXn - Tx\\ + \\Tx\\ < |1.T„ - x\\ + \\Tx\\ < \\Xn\\ + \\x\\ + \\Tx\\ 

||Ta;„-x„|| = |[(A„+ia: + (1 - A„+i)ra;„ - A„+i(a; - Tx„)) - a;„|| 

||a;„+i - x„ - A„+i(x - Ta;„)|| < ||x„+i - a;„|| + A„+i||a; - Txn\\ 

\\xn+i - Xn\\ = |lA„+ix + (1 - A„+i)ra;„ - A„x - (1 - A„)ra;„_i|| 

= - A„)a; + (1 - A„+i)(T.t„ - Txn-i) + (A„ - A„+i)Ta;„_il 

= \\i>^n+i - K)ix - Txn-i) + (1 - A„+i)(Ta;„ - ra;„_i)|| 
< |A„+i - A„| • \\x - Ta;„_i|| + (1 - A„+i)||.t„ - x„_i||, 
since T is nonexpansive. 

2. is an immediate consequence of[TJ 

□ 
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Lemma 3.2. Let (A„)„>i be a sequence in [0,1] and (a„)„>i, (&„)„>i be se- 

OG 

quences in such that 6„ is convergent and 

n=l 

Gn+i < (1 - A„+i)a„ + bn for all n e N* . 

Then 

1. for all m,n eW, 



n+m— 1 



n (i-^^+i) 



n+m— 1 



(7) 



2. (a„) is bounded. 
Proof. 1. By an easy induction on m. 

2. Applying ([7]) with n := 1, we get that for all m > 1, 



< ttm+l < 



i=i 



m 



oo 



fli + ^ 5j < ai + ^ 6j < fli + ^ bj < oo, 
j=i j=i j=i 



since ^ Thus, (a„) is bounded. 



□ 
□ 



The following lemma is a quantitative version of [17, Lemma 2]. 
Lemma 3.3. 

Let (A„)„>i be a sequence in [0, 1] and (a„)„>i, (6,i)n>i be sequences in M+ such 
that for all n G N* , 

a-n+i < (1 - A„+i)a„ + bn. (8) 

oo oo 

Assume moreover that A„ is divergent, 6„ is convergent and let 5 : N* 

n—l n—1 

oo 

N* be a rate of divergence of A„, 7 : (0, oo) ^ N* be a Cauchy modulus of 



n=l 



(sm)m>i, where Sm ■= bi. 

Then lim a„ = and moreover 

n — ^oc 



Ve e (0, 2)Vn > /i(7, 5, £>, e) (a„ < e) , 



(9) 



wher 



h{j,5,D,e) = di^j[-)+l 
D eN* is an upper bound on {an). 
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Proof. By Lemma l??^ (a„) is bounded, so there exists D G N* such that a„ < D 
for all n e N*. Let e G (0, 2) and define 

(10) 



TV := 7 ( 2 j + 1- 



Applying (l7|) with n N, it follows that for all m G N 

ClN+m < 



N+m-1 

n (i-^j+i) 



N+m-1 

aN+ 



j=N 

(N+m-l \ N+m-1 

i=Af / j=N 

since 1 — a; < exp(— x) for all x G [0, oo) 

/ N+m-l \ 

= exp - J2 ^J+i + (S(f )+™ - ^(f ) 



/ N+m-1 \ ^ 

< ZJexp - Xj+i aw + -, 

V J=N J 

since 7 is a Cauchy modulus of (sm). 



(N+m-l 
— ^ Aj_|_i . We have got then 

that for all m G N*, 



m "T ■ 



(11) 



Let us note that 



N+m-1 



N+m-1 



dm<^ <^ exp - Y ^J+i - ^ ^ " II ^^+1 - (^) 



N+m-1 



j=N 
N+m 



N+m 

E 

i=N+l 



Let 



M ■.= 6{N + 



In 



2L> 



TV. 



(12) 



Since 5 is a rate of divergence of A„ and A„ < 1, it is obvious that S{n) > n 

n=l 

2D f2D\ 
for all n G N*. Using also the fact that > Z? > 1, so In I j > 0, it is 



easy to see that M G N*. Moreover, for m > M , we get that 



N+m N+M 



^ A, > ^ A, > iV - 



i=l 



1=1 



Mf) 



N 



>^Xi+ In 



2D 



O-N+M+n < £• 



Hence, dm < ^ f'^'' ''^ — Combining this with (fTT|) . we get that for ah 

m > M, ttN+m < £, that is 

for all n G N. Define 

h{-f,S,D,e) ■.= N + M = S(N- 



mif 



(13) 



(14) 



Then ([9]) follows. Thus, linia„ = and h{'-f,S,D,e) is a rate of convergence of 
(a„) towards 0. □ 

4 Proof of Theorem 12.11 

By Lemma [3. 11 we get that M > ||a;„||, ||ra;„|| for all n > 1 and 

||a;„+i - Xn\\ < (1 - A„+i)||a;„ - a;„_i|| + 2M ■ |A„+i - A„|. (15) 
Let us consider the sequences 

an := \\xn - Xn^iW, 6„ := 2Af |A„+i - A„| 
and let D := 2M. Then D is a bound on (a„) and, by (fT5|) . for all n > 1, 

fln+i < (1 — A„+i)a„ + 6„. 

oo 

Moreover, A„ is divergent with rate of divergence 9 and if we define 



7:(0,oo)-.N*, 7(£):=/3(^) 



we get that for all n e N* 



7(e)+n 7(£) /-f{e)+n 7(5) 

^ 6, - ^ fe, = 2Af ^ |A,+i - A,;| - ^ |A,;+i - A, 



1=1 \ i=l 

^ 2M (s 



so bn is convergent and 7 is a Cauchy modulus of j bi 
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Thus, the hypothesis of Lemma [3.31 are satisfied, so we can apply it to get 
that for all e e (0, 2) and for all n > hi{(3, 0, M, e) 



\\Xn - Xn^lW < -, 



(16) 



where 



h,iP,9,M,e) := (^/3 (^) + 1 ^ 
By Lemma r3.1l2[ for all n > 2, 

ll-^n — 1 ~ ^'^n— 1|| — W'^n -^n — 1| 



In 



/8M 



2MA„. 



(17) 



of (A„) towards 0, we get that for all n > /i2(q!, Af, e 



Let h2{a, M, e) := a 



Then, using the fact that a is a rate of convergence 

(18) 



2AfA„<2Af— = - 
Combining ([16]), ((T7|) and (HH]), it follows that 

\\Xn-l - TXn-l\\ < e 



for all n > uiax{hi{P,9,M,e),h2{a,M,e)}, so the conclusion of the theorem 
follows with <i> defined by ([7]) . □ 
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